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(54) VIDEOPHONE SYSTEM USING CELLULAR TELEPHONE TERMINAL 



(57) When a call-up is generated, an data type iden- 
tifying unit of a CPU identifies the type of data type infor- 
mation which is appended as a header to received data 
as one of sound data, text data, and image and sound 
data, and displays the type on a display unit comprising 
a monitor. When the type is sound data or text data, an 
application for executing a corresponding telephone 
function or data communication function is activated via 
the user line connection. When the type is image and 
sound data, an application for executing a correspond- 
ing visual telephone function is activated after line con- 
nection. 
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Description 

BACKGROUND OF THE INVENTION 

1. Field of the Invention s 

[0001] The present invention relates to a visual tel- 
ephone system in which a visual telephone function is 
appended to a mobile communication terminal having a 
telephone function and a data communication function. 

2. Description of the Related Art 

[0002] Good operability is demanded in realizing a 
visual telephone system comprising a visual telephone 
function appended to a mobile communication terminal 
having a telephone function and a data communication 
function using a communication unit which is capable of 
high-speed data transmission, such as PDC (Personal 
Digital Cellular), CDMA (Code Division Multiple 
Access), GSM (Global System for Mobile Communica- 
tion) and PHS (Personal Handy-phone System), in addi- 
tion to WCDMA (Wide band CDMA), CDMA 2000, and 
the like, which are being developed as next-generation 
technology. 

[0003] The reason for this is that, for example, when 
a telephone call has been received, the person receiv- 
ing the call moves his face near to the mobile communi- 
cation terminal and speaks. In the case of a visual 
telephone call, he speaks while watching the face of the 
caller which is displayed on a display at a fixed distance 
from his own face. 

[0004] However, when a visual telephone function 
has been appended to the mobile communication termi- 
nal as mentioned above, it is not possible to know which 
type of call has been received. This makes it difficult to 
smoothly receive telephone calls and visual telephone 
calls. 

[0005] In order to receive calls smoothly, the user 
needs to know in advance which type of call is being 
received. After confirming the type of the received call, 
the user must activate functions for that mode. 

SUMMARY OF THE INVENTION 

[0006] The visual telephone system using a mobile 
communication terminal of the present invention has a 
telephone function and/or a data communication func- 
tion. In addition, a visual telephone function is 
appended by connecting a camera, comprising an 
image sensor, in a single body with a display unit which 
displays images. The system comprises an data type 
identifying unit which identifies whether the received 
data is sound data, text data, or image and sound data, 
based on data type information which was appended in 
advance as a header to the received data; a registering 
unit which stores a plurality of application programs 
comprising application programs for executing at least 



the visual telephone function; and a control unit which 
activates an application program in correspondence 
with data type information, identified by the data type 
identifying unit. 

[0007] According to the visual telephone system 
using the mobile communication terminal, when a com- 
munication is received, the control unit activates an 
application which corresponds to data type information, 
appended as the header of the received data. There- 
fore, there is no need for controls such as activating a 
mode in accordance with the type. Consequently, the 
visual telephone system for visual communication can 
be controlled smoothly, and the amount of control which 
must be executed by the user can be greatly reduced. 
[0008] In another aspect of the visual telephone 
system using a mobile communication terminal, a visual 
telephone function is appended by attaching a detacha- 
ble imaging unit (adaptor) having an image sensor to 
the mobile communication terminal, comprising a dis- 
play unit for displaying images and having a telephone 
function and a data communication function. This sys- 
tem comprises an data type identifying unit which iden- 
tifies whether received data is sound data, text data, or 
image and sound data, based on data type information 
which was appended in advance as a header to the 
received data; a registering unit which stores a plurality 
of application programs comprising application pro- 
grams for executing at least the visual telephone func- 
tion; and a control unit which activates an application 
program in correspondence with data type information, 
identified by the data type identifying unit. 
[0009] According to this aspect of the visual tele- 
phone system using a mobile communication terminal, 
when a communication is received after the visual tele- 
phone function has been appended by attaching the 
detachable imaging unit to the mobile communication 
terminal, the control unit activates an application which 
corresponds to data type information, appended as the 
header of the in-coming information. Therefore, there is 
no need for controls such as activating a mode in 
accordance with the type of data. Consequently, the vis- 
ual telephone system for visual communication can be 
controlled smoothly, and the amount of control which 
must be executed by the user can be greatly reduced. 
[0010] Furthermore, the detachable imaging unit of 
the present invention is attached to a mobile communi- 
cation terminal having a telephone function and a data 
communication function and comprising a displaying 
unit which displays images. The detachable imaging 
unit comprises an image sensor which appends a visual 
telephone function to the mobile communication termi- 
nal. 

[0011] According to the detachable imaging unit of 
the present invention, a visual telephone function can 
be appended extremely easily to a mobile communica- 
tion terminal, such as a personal computer comprising a 
communication unit, by attaching the detachable imag- 
ing unit to the communication terminal thereof. There- 
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fore, the detachable imaging unit has excellent general 
versatility, and can be used easily in various types of 
mobile communication terminal. 

BRIEF DESCRIPTION OF THE DRAWINGS 
[0012] 

Fig. 1 is an external front view of a mobile commu- 
nication terminal having a visual telephone function 
for illustrating the visual telephone system using a 
mobile communication terminal according to the 
present invention; 

Fig. 2 is an external side view of a mobile commu- 
nication terminal having a visual telephone function 
for illustrating the visual telephone system using a 
mobile communication terminal according to the 
present invention; 

Fig. 3 is an external side view of a mobile commu- 
nication terminal having a visual telephone function 
for illustrating the visual telephone system using a 
mobile communication terminal according to the 
present invention; 

Fig. 4 is a block diagram showing functions of the 
visual telephone system using a mobile communi- 
cation terminal according to the present invention; 

Fig. 5 is a flowchart showing operations and con- 
trols in the visual telephone system using a mobile 
communication terminal of the present invention 
when a call is received; 

Figs. 6A and 6B are external perspective views of a 
simple-format information terminal for illustrating 
another visual telephone system using a mobile 
communication terminal according to the present 
invention, Fig. 6A being an external perspective 
view of a detachable imaging unit, and Fig. 6B, an 
external perspective view of a mobile communica- 
tion terminal in which the detachable imaging unit 
has been provided in a single body; 

Fig. 7 is a block diagram showing functions of 
another visual telephone system using a mobile 
communication terminal according to the present 
invention; and 

Fig. 8 is a flowchart showing operations and con- 
trols in the other visual telephone system using a 
mobile communication terminal of the present 
invention when a call is received. 



DESCRIPTION OF THE PREFERRED EMBODI- 
MENTS 

[0013] Preferred embodiments of the visual tele- 
5 phone system of the present invention will be explained 
with reference to the drawings. 
[0014] Fig. 1 is a front view showing the outside of a 
mobile communication terminal having a visual tele- 
phone function according to the present invention, and 
10 Figs. 2 and 3 are side views showing the outside of the 
mobile communication terminal having a visual tele- 
phone function. 

[0015] As shown in Figs. 1 to 3, a monitor 21 com- 
prises a colour liquid crystal plate, and is provided in 

15 front of a terminal main body 20a of the mobile commu- 
nication terminal 20. Image information and/or commu- 
nication function information in the mobile telephone 
apparatus, such as telephone numbers, electric field 
pictures and the like, are/is displayed on the monitor 21 . 

20 The monitor 21 constitutes a display unit of the present 
embodiment. 

[0016] A camera 22 comprises an image sensor 
(explained later) and is provided above the terminal 
main body 20a on the front side, and this camera 22 
25 captures images. A plurality of control key 23 are pro- 
vided below the monitor 21 . Various types of control can 
be executed by pushing the keys 23. Some of the con- 
trol key 23 are provided on one side of the terminal main 
body 20a. 

30 [0017] A speaker 25 is provided next to the camera 
22 at the top of the terminal main body 20a, and func- 
tions as a sound output unit. A microphone 26 is pro- 
vided at the bottom of the terminal main body 20a. 
Sound is input to the microphone 26, and the sound of 

35 the other party's voice, sound notifying an in-coming 
call, alarms, and the like, are output from the speaker 
25. An extendable antenna 27 is provided on top of the 
terminal main body 20a. A built-in RF section 48 
(explained later) transmits and receives image data and 

40 sound data via the antenna 27. 

[0018] An outside power connecting section 28 is 
provided on the other side of the terminal main body 
20a, and connects via an adaptor to an AC power 
source such as a wall socket. An outside sound output 

45 section 29 is similarly provided on the other side of the 
terminal main body 20a, and is connected to an ear- 
phone or the like. 

[0019] A battery lid 24 is provided in the rear side of 
the terminal main body 20a, and can be removed and 

so attached to a storing section which a battery is stored in. 
A stand 24a is joined to the battery lid 24 and can be 
turned within a predetermined angle. By turning the 
stand 24a so as to increase the angle, the mobile com- 
munication terminal 20 can be supported in a sloping 

55 position on an installation surface. 

[0020] Subsequently, the functions of the mobile 
communication terminal 20 having the visual telephone 
function described above will be explained based on the 
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block diagram of Rg. 4. 

[0021] As shown in Fig. 4, a simple-format informa- 
tion terminal 20 comprises an image sensor 36 included 
in the camera 22 which converts an image formation 
object into an electrical signal (pixel signal), an A/D con- s 
verter 37 which converts the output of the image sensor 
36 to digital signals, a processor 38 comprising a dither 
image processing section 39 which converts the output 
from the A/D converter 37 to dither image data and a 
sound processing section 40, a CPU 43 which forms a 
control unit for controlling the telephone function using a 
communication unit such as a PHS and data communi- 
cation functions, an application registering section 44 
which forms a registering unit for storing a first applica- 
tion program for executing the telephone function, a 
second application program for executing the data com- 
munication function, and a third application program for 
executing a visual telephone function, a memory 45 
which stores call information data, such as text transmit- 
ted and received by data communication, and image 
data, a display driver 46 which drives a display section 
comprising the monitor 21 for displaying images and the 
like, a key input interface 47 which connects control sec- 
tion comprising the control key 23 for telephone and 
data communication, capturing, reproducing and trans- 
ferring images, to the CPU 43, and an RF section 48 
which the antenna 27 is connected to for telephone and 
data communication with the terminal of another party 
by using a PHS line. 

[0022] The CPU 43 includes an information identify- 
ing section 43a comprising an data type identifying unit 
which identifies types of data based on the data type 
information appended as headers to the received data. 
[0023] Subsequently, the operations and controls of 
the mobile communication terminal which a telephone 
function is appended to, as described in the above con- 
stitution, will be explained based on the flowchart shown 
in Fig. 5. 

[0024] The mobile communication terminal 20 
receives data via the antenna 27 and the RF section 48 
(step (hereinafter termed "S") 301). 
[0025] When the CPU 43 determines that the 
received information is a call-up to itself, the CPU 43 
carries out call-up and uses its information identifying 
section 43a to identify the type of data which is 
appended as a header to the received data (S302). 
[0026] The CPU 43 controls the display driver 46 so 
as to display the type of the in-coming telephone com- 
munication, data communication or visual telephone 
communication on the display section comprising the 
monitor 21 (S303). 

[0027] Since the user can learn the type of in-com- 
ing communication from the display, he can handle the 
communication appropriately when he answers. 
[0028] The user answers by pressing a communica- 
tion key among the control key 23 (S3024, S308, or 
S309). In the case of sound data, the CPU 43 activates 
an application for telephone communication from the 



application registering section 44 (S305). In the case of 
text data, the CPU 43 activates an application for data 
communication (S307). Consequently, telephone con- 
versation and data reception can be smoothly control- 
led. 

[0029] In the case of image and sound data, the 
CPU 43 activates an application for visual telephone 
from the application registering section 44 (S309). 
[0030] After an application appropriate to the infor- 
mation type has been activated in this way, the user can 
control the communication smoothly. 
[0031] According to the visual telephone system 
using the mobile communication terminal 20, when a 
call is received, the CPU 43 activates an application 
which is suitable to the type of data based on the data 
type information appended as a header to the received 
data. Therefore, it is not necessary to activate functions 
of a mode or the like in correspondence with the infor- 
mation type. Consequently, the visual telephone system 
for visual communication can be smoothly controlled, 
and the amount of control executed by the user can be 
greatly reduced. 

[0032] The above embodiment described an exam- 
ple in which the display can be viewed on the monitor 21 
of the mobile communication terminal 20, but the type 
display can be identified audibly. For example, the audio 
features and patterns of the sound notifying that there is 
an in-coming call can be set to correspond separately to 
data communication and visual telephone. 
[0033] In the embodiment described above, the 
mobile communication terminal 20 which a visual tele- 
phone function is appended to comprises a monitor 21 
and a camera 22, provided together in a single body. 
Alternatively, a unit for appending the visual telephone 
function may be separately provided to the mobile com- 
munication terminal. 

[0034] One example of this type of mobile commu- 
nication terminal will be explained. 
[0035] Figs. 6A and 6B are diagrams showing the 
outside of a mobile communication terminal 20. Fig. 6A 
is an external perspective view of a detachable imaging 
unit, and Rg. 6B is an external perspective view of a vis- 
ual telephone system in which the detachable imaging 
unit has been provided in a single body with the mobile 
communication terminal. 

[0036] As shown in Figs. 6A and 6B, the detachable 
imaging unit 52 is attached to the mobile communica- 
tion terminal 51 , and comprises a camera unit 54 for 
capturing an image of the object. The camera unit 54 is 
provided above a PC card slot 56, and can be rotated 
around a supporting section 55 so as to change its cap- 
turing direction in the direction of the arrow. An elec- 
tronic circuit is provided in the PC card slot 56 portion, 
and a battery storage section 53 is provided therebelow. 
[0037] The mobile communication terminal 51 has 
a data communication function and a telephone function 
using a communication unit, such as a PHS, and as 
above comprises a top flip comprising a monitor 57 as a 
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display section, a speaker 63, an antenna 60, and the 
like; and a bottom flip comprising a control section 
which comprises control key including having ten-key, 
selection key, and function keys such as a communica- 
tion key 58 and an attachment decision key 59 for deter- 
mining whether the user has decided to attach. The top 
and bottom flips can be folded together. 
[0038] The visual telephone system is realized by 
attaching the PC card slot 56 of the detachable imaging 
unit 52 to a slot connection terminal, provided at the 
lower end of the bottom flip of the mobile communica- 
tion terminal 51 . 

[0039] As shown in Fig. 7, in the visual telephone 
system which comprises the detachable imaging unit 52 
attached to the mobile communication terminal 51 in the 
manner described above, the PC card slot 56 is pro- 
vided on the detachable imaging unit 52 side and a slot 
connection terminal 64 is provided on the mobile com- 
munication terminal 51 side. 

[0040] By attaching the PC card slot 56 of the 
detachable imaging unit 52 to the bottom flip of the 
mobile communication terminal 51 , the PC card slot 56 
of the detachable imaging unit 52 becomes connected 
to the slot connection terminal 64 of the mobile commu- 
nication terminal 51, enabling signals to be exchanged 
between the processor 38 of the detachable imaging 
unit 52 and the CPU 43 of the mobile communication 
terminal 51. 

[0041] The CPU 43 of the mobile communication 
terminal 51 further comprises an attachment status 
detector, comprising an attachment status detecting 
section 43b, which detects whether or not the detacha- 
ble imaging unit 52 is attached. 
[0042] As shown in Fig. 8, in this type of visual tele- 
phone system, when the data type information com- 
prises image and sound data, the processes executed 
from S308 onwards are different from those in the case 
of the single-body mobile communication terminal 20 
described earlier. 

[0043] When the data type information comprises 
image and sound data, the CPU 43 uses the attachment 
status detecting section 43b to determine whether the 
detachable imaging unit 52 is attached (S31 0). 
[0044] When it is determined that the detachable 
imaging unit 52 is attached from the start, an application 
for visual telephone is activated from the application 
registering section 44 (S311). 

[0045] On the other hand, when the detachable 
imaging unit 52 is not attached, a message suggesting 
attachment is visually or audibly displayed and it is 
determined whether the user has decided to attach 
(S312). 

[0046] When the user decides not to attach and 
manipulates the attachment decision key accordingly, 
the line is disconnected (S313). When the user has 
decided to attach, the CPU 43 grants a delay and waits 
for a predetermined period of time. In addition, the CPU 
43 transmits information, stating that the detachable 



imaging unit 52 is being attached, to the terminal of the 
other party. 

[0047] The attachment status detecting section 43b 
once again determines whether the detachable imaging 
5 unit 52 has been attached (S310). The line is discon- 
nected when the predetermined delay time has 
elapsed. 

[0048] In the case where the user has not manipu- 
lated the attachment decision key 59 at all, the line is 
w disconnected after the predetermined period of time 
has elapsed. 

[0049] When the detachable imaging unit 52 has 
been attached, the application for visual telephone is 
activated from the application registering section 44 in 

15 the same way as when the detachable imaging unit 52 
was attached from the start (S31 1). 
[0050] According to the visual telephone system 
using the mobile communication terminal 51, when a 
call is received after the visual telephone function has 

20 been appended by attaching the detachable imaging 
unit 52, the CPU 43 activates an application which cor- 
responds to data type information, appended as the 
header of the received data. Therefore, there is no need 
for controls such as activating a mode in accordance 

25 with the type. Consequently, controls in the visual tele- 
phone system using visual communication can be exe- 
cuted smoothly, and the amount of control which must 
be executed by the user can be greatly reduced. 
[0051] The visual telephone function can be 

30 appended to the mobile communication terminal 51 
extremely easily by attaching the detachable imaging 
unit 52 to the mobile communication terminal 51. This 
detachable imaging unit therefore has excellent general 
versatility, and can be used easily in various types of 

35 mobile communication terminal. The detachable imag- 
ing unit can be attached extremely easily to communi- 
cation terminals such as a personal computer 
comprising a communication unit, thereby appending 
the visual telephone function thereto. 

40 [0052] The above example described a PHS com- 
munication unit. However, the communication unit is not 
limited to PHS, and can be applied to a great variety of 
communication units such as PDC, CDMA, GSM, 
WCDMA, and CDMA2000. 

45 [0053] As described above, according to the visual 
telephone system using the mobile communication ter- 
minal of the present invention, when a call is received, a 
controller activates an application which corresponds to 
data type information, appended as the header of the 

so received data. Therefore, there is no need for controls 
such as activating a mode in accordance with the type. 
Consequently, controls in the visual telephone system 
using visual communication can be executed smoothly, 
and the amount of control which must be executed by 

55 the user can be greatly reduced. 
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Claims 

1. A visual telephone system using a mobile commu- 
nication terminal having a telephone function 
and/or a data communication function, and a visual 
telephone function appended by connecting a cam- 
era comprising an image sensor to a display unit 
which displays images in a single body, comprising: 

an data type identifying unit which identifies 
whether received data is sound data, text data, 
or image and sound data, based on data type 
information which was appended in advance 
as a header to received data; 
a registering unit which stores a plurality of 
application programs comprising application 
programs for executing at least the visual tele- 
phone function; and 

a control unit which activates an application 
program in correspondence with data type 
information, identified by said data type identi- 
fying unit 

2. A visual telephone system using a mobile commu- 
nication terminal according to claim 1 , said plurality 
of application programs comprising an application 
program for executing a telephone function and an 
application program for executing a data communi- 
cation function. 

3. A visual telephone system using a mobile commu- 
nication terminal according to claim 1 , wherein said 
display unit or said sound output unit visually or 
audibly displays contents of datatype information of 
said header prior to line connection when receiving 
said received data. 

4. A visual telephone system using a mobile commu- 
nication terminal which a visual telephone function 
has been appended to by attaching a detachable 
imaging unit having an image sensor to a mobile 
communication terminal, comprising a display unit 
for displaying images and having a telephone func- 
tion and a data communication function, the visual 
telephone system comprising: 

an data type identifying unit which identifies 
whether received data is sound data, text data, 
or image and sound data, based on data type 
information which was appended in advance 
as a header to received data; 
a registering unit which stores a plurality of 
application programs comprising application 
programs for executing at least the visual tele- 
phone function; and 

a control unit which activates an application 
program in correspondence with data type 
information, identified by said data type identi- 



fying unit. 

5. A visual telephone system using the mobile com- 
munication terminal according to claim 4, said plu- 
5 rality of application programs comprising an 
application program for executing a telephone func- 
tion and an application program for executing a data 
communication function. 

w 6. A visual telephone system using the mobile com- 
munication terminal according to claim 4, wherein 
said display unit or said sound output unit visually 
or audibly displays contents of data type informa- 
tion of said header prior to line connection when 

75 receiving said received data. 

7. A visual telephone system using the mobile com- 
munication terminal according to claim 4, further 
comprising an attachment status detecting unit 

20 which detects whether said detachable imaging unit 
is attached when said data type identifying unit has 
determined that the information comprises image 
and sound data; 

wherein said control unit visually or audibly 

25 displays a message suggesting attachment of said 
detachable imaging unit when said attachment sta- 
tus detecting unit has determined that said detach- 
able imaging unit is not attached. 

30 8. A visual telephone system using the mobile com- 
munication terminal according to claim 7, further 
comprising an attachment decision unit which 
allows a user to decide whether to attach said 
detachable imaging unit after said attachment sta- 

35 tus detecting unit has determined that said detach- 
able imaging unit is not attached; 

wherein said control unit disconnecting the 
line when said attachment decision unit has deter- 
mined that the user has decided not to attach said 

40 detachable imaging unit. 

9. A visual telephone system using the mobile com- 
munication terminal according to claim 8, wherein, 
when said attachment decision unit has determined 

45 that the user has decided to attach said detachable 
imaging unit, said control unit waits a predeter- 
mined period of time for the attachment of said 
detachable imaging unit, disconnecting the line in 
the case where said detachable imaging unit is not 

so attached within the predetermined period of time. 

10. A visual telephone system using the mobile com- 
munication terminal according to claim 9, wherein, 
when waiting for the attachment of said detachable 

55 imaging unit, that fact is displayed at the mobile 
communication terminal of the other party. 

11. A detachable imaging unit which is attached to a 



6 



10/11/2006, EAST Version: 2.0.3.0 



11 EP 1 096 771 A1 12 

mobile communication terminal having a telephone 
function and a data communication function and 
comprising a displaying unit which displays images, 
the detachable imaging unit having an image sen- 
sor which appends a visual telephone function to 5 
said mobile communication terminal. 

12. A detachable imaging unit according to claim 11, 
having a slot connector which a card slot section of 
said mobile communication terminal is inserted w 
into, the output from said connector element being 
transmitted to said mobile communication terminal 
by inserting the card slot section of said mobile 
communication terminal into the slot connector. 
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